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■   CHAIT^ER  I 
D-!TRODUCTION 

In  recent  years  technology  has  increased  almost  exponentially. 
l^ndamental  to  the  progress  of  our  advancing  technology  is  the  capability 
to  acquire,  process,   and  interpret  information,   or  data,   and  to  make 
logical  decisions  based  on  .such  interpretations.     The  device  vjhich. con- 
tributes largely  to  the  rapid  processing  of  data  is  the  electronic 
digital  computer. 

This  advancing  technology  requires  highJ.y  skilled  and  well  edueatid 
personnel  to  fill  today's  existijig  positions  and  tomorrovj's  new  and 
diverse  positions.     Our  educational  system  has  been  ejctrsriely  Influenced 
by  the  applications  of  digital  computers. 

Computer  usage  in  education  can  be  divided  into  four  categories. 
The  first  category  is  computer-assisted  instruction  which  Fishnan ; et 
al.   (1968)  refer  to  as  an  "instructional  procedure  which  utilizes-a 
computer  to  control  part,   or  all  of  the  selection,   sequencing,:- and 
evaluation  of  instructional  materials."     The  second  category  is:ca7iputer 
application  in  administration.     Silvern  and  Silvern  (I966)  include  class 
scheduling,  attendance  recording,  record  accounting,  test  scoring  and 
analysis,  and  report  generating  in  this  area. 

Thirdly,   compaters  are  used  as  a  tool  in  conjunction  with  other 
courses,  the  most  obvious   ones  being   engineering,  the  sciences,  mathe- 
matics, and  business.     The  fourth  category  of  computer  usage  is  that "the 
computer  can  be  a  subject  in  itself,  involving  uses,  languages,,  pro- 
gramming, logic,  and  theory.  ■'-.   .  . 
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It  was  this  last  category,  the  computer  as  a  object  itself, 
specifically  programming,  that  was  of  major  interest  in  this  paper. 
Cliapman  and  Carpenter  (I962)  list  eight  principles  of  teaching 
which  have  evolved  over  the  centiH-ies.     One  of  these  is  that  misunder- 
standings should  bo  detected  and  corrected  irj^odiately.     It  is  obvious 
that  when  one  is  learning  to  program,  mistalces  or  errors  will  be  m.ade. 
Beforehand  knowledge  as  to  what  types  of  errors  vdll  be  made  and  what 
factors  influence  the  making  of  these  errors  could  bo  of  great  benefit 
to  those  that  teach  programmers. 

Such  knowledge  could  improve  the  efficiency  of  learning  to.  program 
the  computer,  an  important  part  of  our  advancing  technology.  As  stated 
by  Goodman  (I962),  to  simplify  programmijig  is  one  of  the  important  tasks 
before  us  today  in  the  field  of  comj^tation,  for  unless  ordinary  people 
can  use  computers,  and  understand  a  fair  amount  about  them,  the  contri- 
bution these  machines  can  make  to  society  will  only  be  partially  appre- 
ciated and  partially  realized. 

I.   DSFEITIOK  OF  TERMS 
WATFOR  Compiler.     The  VJATFOR  (from  WATERLOO  FORPRAI^j)   compiler  for-.the 
System  360  is  an  in-core,   one-pass,  load-and-go  processor  which  accepfes 
FORTRAi^i  IV  programs  to  be  compiled  and  executed. 

Error.     An  error  vias  a  diagnostic  message  code  printed  out  by  the  TiATEffi /36O 
compiler  as  listed  in  Appendix  B  of  Blatt   (I968), 

Run  Number.     A  run  number  vras  the  sequential,   student  assigned  number 
for  each  separate  run  of  a  specific  probles^i,    • 
.  TvT'e  of  St-ror.     Errors  were  grouped  into  the  same  categories  or  types 
as  listed  by  Blatt.     For  example,  DO  LOOPS  and  DBIEiiSICII  statements "vjere 
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tv;o  typ'9s  of  errors, 

Classa.fication«     Classification  referred  to  the  school  year  of  the  stu- 
dents.    Classifications  \rere  freshraan,   sophomore,   junior,   senior,  and 
graduate  students. 

Category.     A  category  V7as  a  subclass  of  a  variable  and  was  used  in. con- 
junction vdth  a  chi-square  program.     For  e3:arfiple,  the  variable  sex  had 
two  subclasses  or  two  categories,  male  and  fonale. 

II.  statmh:-!  of  the  problem 

There  were  tvi-o  purposes  for  this  study.     The  first  purpose  was 
to  deteiTaine  w}-iat  kinds  of  errors  were  made  by  beginning  programming 
students.     The  second  pirpose  vxas  to  determine  vjhat  effect,  if  any, 
the  follovjing  factors  had  upon  the  errors  that  wei'e  made  by  students: 
(1)  instinictor,   (2)  laboratory  problem  number,   (3)   sex,    (4)  major,  and 
(5)  classification. 

III.   HiPORTAIICE  OF  THE  STUDY 

To  be  able  to  pi'edict  what  types  of  errors  beginning  programming 
students  were  most  likely  to  make  would  be  beneficial  not  only  to 
educators,  xdiether  in  the  formal  school  systan  or  ijn  industry,  but 
also  to  those  developing  the  instructional  material.     More  eraphaisis 
could  be  given  to  the  areas  that  are  producing  the  most  errors,  in 
hopes  of  significantly  reducing  their  occurrence. 

IV.  OBJECTIVES  OF  THE  STUDY 

The  objectives  of  this  study  stated  as  null  hypotheses  were: 

1)  ?>rors  made  by  beginning  programming  students  vrere  independent: a f 
instructor. 

2)  Errors  made  by  beginning  programming  students  vrere  independent 


of  laboratory  problem, 

3)  Errors  niade  by  begiiming  prograraming  students  vjere  independent 
of  major.      '.  .  ,  .    '  ■   : 

4)  Errors  made  by  beginning  programming  students  were  independent 
of  classification, 

5)  Errors  made  by  beginning  programming  students  were  independent 
of  sex,  ■  •  . 

V.   DESCRIFriOK  OF  THE  SAl-IFLE 

During  the  spring  semester  of  the  I968-I969  school  year  a'  total 
of  194  students  vrere  enrolled  in  the  course  Fundamentals  of  Compater 
Programming  at  Karisas  State  University,     These  students  were  randomly 
assigned  into  six  classes,  taught  by  five  instructors. 

Four  of  those  classes,   each  taught  by  a  different  instructor*, 
were  used  for  this   study.     The  subjects  for  this  study  consisted. of 
seventy-three  males  and  eleven  females, 
;    ■-,  .  VI.   CHI-SQUARE 

The  chi-square  distribution  provides  a  means  of  comparing  Trainber 
of  observed  sampling  occurrences  with  theoretical  frequencies.  t>f 
occurrence  of  these  saiie  events  \inder  some  hypotheses  for:  k  categories. 
The  statistic  is 


k 

IS 


2     =      2     (fi    -  Fi)2 


i=l         Fi 

where  fi  represents  the  observed  frequencies  and  Fi  is  some  theoretical 
frequency,     Chi-squaro  critical  values  were  obtained  from  Concepts  arid 
Methods  of  B>cperimental  Statistics  by  Fryer  (I966), 


CHAPTER  II  ;■     . 

METHOD  OF  RESSAP.CH 

All  four  instructors  used  the  same  textbook,  Iritroduction  to 
FORTRAI''  r/  Frogranming :   Using  the  WATFOR  Compiler  by  Blatt.     Four 
identical  laboratory  problems  were  assigned  to  each  class  on  the  same 
day.     Problems  were  due  from  the  students  in  two  weeks.     T^'Jo  of  the 
classes  were  also  assigned  a  fifth  problem.     The  results  from  these 
tv;o  classes  are  also  included  in  this  study. 

Each  student  was  recjuired  by  his  instructor  to  complete  a 
questioraiaire  (Appendix  A)  for  each  laboratory  problera.     All  Watfor 
message  codes  vfere  to  be  listed  according  to  sequential  run  nujiiberrfcr 
each  laboratory  problam.     The  student  was  asked  to  check  the  appropriate 
category  if  he  believed  that  the  error  occurred  as  a  result  of  onecf 
the  following  types:  key  punch  error,    'dimension'   statement,    'format?, 
data,  use  of  'common',    'logical  if,    'arithmetic  if,  and  'go  to' 
statement, 

A  program  was  x-jritten  in  FORTRAN  to  total  the  results  of  the  error 
sheets.     Cbd-square  statistics  were  gathered  by  using  the  Kansas  State 
University  Statistical  Library  Clii-square  program.     Mean  statistics 
were  provided  by  the  Kansas  State  University  Statistical  Library 
Generalized  Keans  program  (I968),         ,  -  ■■ 
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CHAPTER  III  -  ■  ■ 

■  .;  RESULTS  OF  THE  STUDY 

■    ■-:     ^        ■.         FRiiXiUSlCIES  M.'D  Pi2lCEI-]TAGES 

A  total  of  2,148  errors  were  recorded  from  the  students  in  the 
four  classes,  1,957  Trom  male  students,  191  from  fanale  students. 
I'iales  accounted  for  slightly  more  errors  than  females.     i-5ales  repre- 
sented Q7i  of  the  total  number  of  students  and  committed  91^  of  the 
total  errors.     Figures  for  the  feraales  were  13^  and  9i  respectively. 
Class   size  ranged  from  sixteen  to  twenty-seven.      Class  one  had 
twonty-se^^en  students,  twenty-five  males,  and  two  females.     Class: two 
had  sixteen  students  mth  only  one  female.     Class  three  had  twenty-one 
students,    sixteen  nales  and  five  females.     Class  four  had  twenty  with 
seventeen  males  and  three  females. 

The   students  represented  five  classifications,  freslman  to  gradu- 
ate students.     Freshmen  were  2QF}o  of  the  total  number  of  students  arid 
made  22^  of  all  errors.     Sophomores  were  32^  of  the  students  but  made 
only  2?^  of  the  errors.     Juniors  were  2^  but  made  2?^  of  the  errors. 
Graduate  students  were  4fs  and  %  respectively. 

A  total  of  twenty-eight  majors  were  represented  by  these  eighty- 
four  students.     These  majors  were  easily  grouped  into  six  major 
categories.     Percentage  of  total  number  of   students  for  each  major 
category  and  percentage  of   errors  made  by  those  students  are  listed 
in  Table  I.  ■• 


TAKLE  I 


PERCEI.T  OF  STUDSJrrS  BY  MAJORS  AI'iD  PERCSi\T:  OF  ERRORS  BY  STUDEi^S 


ilajor 


$  of  Students 
by  major 


"■fi  of  Errors 
hv  studejits 


Business  Administration 

and  Accoimting 
Engineering 
Matheimatics      ;  '• 
Social  Science 
Physical  Sciences 
Agricultvu-e 


Z'4, 
18^ 
18^ 
\% 
114 

lOfo 


-23^ 

.16^ 
17^ 

-13^ 

12^ 


There  were  281  possible  errors  that  could  have  occurred,     One-hiLlf 
or  1^0  different  errors  did  appear  at  least  once.     Of  these,   seventy- 
eight  occurred  five  times, 

Tlae  nost  frequently  occurring  error  was  ilONB,  or  no  error  occurred. 
This  was  for  two  reasons.     Tlie  first  reason  was  that  many  students  wei^e 
able  to  successfully  complete  the  first  assigned  problem  and  soBe:th-e 
second  problem  on  the  first  run.     Therefore  no  errors  were  made*    .Since 
this  was  a  beginning  programming  course,  the  first  problem  was  delibea^- 
ately  designed  to  be  easy.     Its  main  purpose  was  to  familiarize  the 
students  vrith  the  kej''-ixinch  machines,  procedure  of  assembling  a  caiid 
deck  for  running,   etc,  ... 

The  second  reason  is  that  in  order  to  obtain  the  average  nuraber 
of  rvxis  for  each  laboratory  problem,  the  error  NONE  was  ant'sred:  if -no 
VfATFOR  error  occurred.     Ilany  times  it  was  necessary  to  reruji  the  prob- 
lem because  of  job  control  errors,  >rrong  answers,   output  spacing 
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problans,   etc.     These  constituted  valid  runs;  an  error  had  to  be.  recorded. 

Thirteen  out  of  a  possible  281  errors  accounted  for  50,^  of  the  total 
2,1^  errors  made.     A  listing,  frequency  and  brief  description- of  those 
thirteen  errors  appears  in  Table  II.     A  complete  listing  of  "all  errors 
that  occurred  along  xdth  theii'  frequency,  complete  e>cplanation  and  type 
grouping  is  found  in  Appendix  B« 

The  error  KO-0  meant  that  some  error  occurred  during  compile  timo. 
Even  though  WATFOR  attempted  execution  after  detecting  errors  during 
compilation,  the  erroneous  source  language  statament  could  nut:be 
ececuted,  '    ■  '  - 

:.-    ■'         ."    ;.  ■  TABLE  II  ■;'  • 

LISTII-B  OF  TIE  THIRTEEil  MOST  FREQUEIWLY  OCCURRING   SIHGLE  ERRORS 


Error  Code 


Frequency 


Scplanation 


NONE 
KO-0 
SX-0 
PC-O 
SS-1 
UN-O 

sr-5 

UV-2 

IF-3 

W-O 
DO-5 
SV-1 

E3-8 


2^0 

103 

102 

96 

91 
68 

65 
61 

54 

52 
5-1 
45 

44 


No  error  occurred. 

Compile  time  error. 

1-Iissing  operator. 

Unmatched  parentheses. 

Subscript  out  of  range. 

Control  card  encountered  on  card  ;rea.ciiT 

during  escecution. 

Undecodeable  statement. 

Undefined  variable-array  number. 

Arithmetic  or  invalid  expression'  in 

logical  IF. 

Undefined  variable-simple  variable. 

Invalid  DO-LOOP  parameter. 

Array  name  or  subprogramme  name  used 

x^rithout  list. 

Illegal  use  of  equal  sign. 


To  receive  a  SC-0  error,  an  operator  such  as   '+' ,    '-',    '*',.'/?» 
'**»,  was  left  out  of  an  expression.     For  example  'A=BC'   could  have 
been  key  ponched  instead  of   'A=B+C'. 

Since  parentheses  must  be  matched  in  FORTRAII  programnmig,  failure 
to  do  this  would  result  in  a  PC-0  error.     This  error  suggested  that 
matching  of  parentheses  should  be  heavily  stressed  when  instructing-. a 

FORTRAN  course. 

The  SS-1  error  meant  that  a  subscript  exceeded  the  number  of -.a 
corresponding  DEISIISIOK  statement.     Either  students  are  not  sure  hovrto 
use  a  DBiSIISIOr!  statem^t  or  they  do  not  fully  understand  the  relation- 
ship of  subscripted  variables  to  the  DMENSION  statement. 

If  a  control  card  was  encounted  (usually  the  end-of-job  card) 
when  attempting  to  read  a  data  card,  a  UN-0  error  occurred.     Special 
programming  techniques  are  needed  to  avoid  making  the  above  error.  -If 
these  techniques  were  taught  earlier  in  a  beginning  programmijrig  course, 
perhaps  the  occurrence  of  the  UK-0  error  could  be  reduced. 

An  undecodable  statement  error  of  ST -5  can  mean  anything.     This 
error  would  be  extremely  difficult  to  reduce.     For  example,  if  the 
statement   'IF  (A.GT.B)  THEI^!  A=B'  was  used  this  error  would  result.     The 
word  'THEN'  has  no  valid  meaning  in  FORTRAIm.     The  statment  should  have 
been   'IF  (A.GT.B)   A=B«. 

The  errors  UV-2  and  UV-0  are  directly  related.     One  has  attanpted 
to  use  a  variable  on  the  right  of  an  equal  sign  before  it  has  been 
assigned  a  value  by  appearing  to  the  left  of  an  equal  sign.     By  com- 
bining the  frequency  of  these  two  errors,  this  became  the  second  most 
common  error.     More  instruction  might  help  to  reduce  these  errors. 
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The  errors  IF-3  and  EQ8  usually  resulted  for  the  sane  reasor..   -To 
get  the  first  error,  an  arithiaetic  expression  appeared  in  a  LOGICAL-IF 
statement.     The  SQ-8  error  resulted  from  illegal  usage  of  an  equal  sign. 
For  ©cample,  if  the  expression   'IF  (A=B)   S'  was  used  the  above  errors 
vjould  have  occurred.     The  expression  should  have  been   'IF  (A.EQ.B)-S!. 
These  errors  were  probably  the  result  of  a  student  not  fully  under- 
standing the  correct  usage  of  arithmetic  and  logical  operators. 

DO-LOCF's  are  commonly  used  in  FORTRM  programs.     The  DO-5  errors 
were  the  result  of  invalid  usage  of  the  DO-LOOP  stateiient. 

4 

The  SV-1  error  resulted  when  either  a  subprogramme  name  appeared 
vnthout  legal  use  of  its  argument  list  or  an  array  narae  appeared  with- 
out its  subscripts.     If  the  error  resulted  because  of  the  first  reason, 
students  probably  need  more  explanation  on  how  to  use  subprogramnes. 
If  the  error  resulted  because  of  the  latter  reason  this  meant  that 
students  did  not  understand  the  usage  of  subscripts.     This  closely 
tied  in  with  the  SS-1  error  described  earlier. 

Since  all  students  were  instructed  from  the  same  textbook"  a'  few 
comments  need  to  be  made  concerning  the  emphasis  the  author  placed 
upon  the  instructional  material.     A  list   of  topics  along  mth  the 
number  of  p-ages  devoted  to  each  topic  can  be  found  in  Table  HI.     The 
number  of  errors  directly  related  to  each  topic  is  also  given  in  this 

table.     :■     v  -- 

Material  concerning  the  topic   'Arithmetic  and  Logical  Statemonti' 
was  covered  in  eleven  pages.     However,  more  errors  were  directly  related 
to  this  toiTlc  than  to  any  other.     A  total  of  537  errors  resulted'from 
arithmetic  a.nd  logical  statement  usage.        • 
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Two  other  topics  \jeve  explained  briefly  by  the  textbook  and 
resulted  in  large  numbers  of  errors.     These  were  'Card  Deck  and  Control 
Cards',  accouiiting  for  five  pages  and  118  errors,  and   'Printed  Out- 
put-Diagnostics and  Terriination' ,  accounting  for  four  pages  and  ,130 
errors.     Because  so  many  errors  resulted  from  these  three  above  nai- 
tioned  topics,  more  er.iphasis  should  be  given  to  these  when  teaching-a 
beginning  programming  course. 

On  the  other  hand,  perhaps  less  emphasis  could  be  given  to  the 
topic  'FOiTTRAi'  ./Arithmetic',  Twelve  pages  were  used  to  explain  this 
topic  but  only  thii'ty-eight  related  errors  were  made.     Another  topic 

TABLE  III 

LIST  OF  TEXTBOOK  TOPICS,  IRJlfflER  OF  PAGES  PER  TOPIC, 
AJ^ID  LIUiSER  OF  ERRORS  RELATED  TO  TOPIC 


TOPIC 


Arithmetic  and  Logical  Statenents 

Go  To  Statements  : 

Arithraetic  and  Logical  IF    •. 

INFlTT/OUrFUT 

Card  Deck  and  Control  Cards 

Printed  Outpat-Diagnostics  and  Termination 

FCiRTRAI!  Arithmetic 

DO  Statement 

Arrays 

Equivalence  and  Common   :  . 

Format 

Type  Declaration  and  Initialization 

Built-in  and  Arithmetic  Statement  Functions 

Function  Stibprograra  ,.    .- 

S^abprogrammes  .  '     --■  '..'-v  '  .  . 


PAGES    ERRORS 


11 

537 

2 

6 

6 

88 

14 

209 

5 

118 

4 

130 

12 

38 

8 

120 

29 

301 

6 

7 

16   . 

24-5 

10 

55 

10 

19 

16 

21 

t- 

■  34 
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needing  less  GRphasis  might  be  'Type  Declaration  and  Ijiitialization.*, 
Ten  pages  of  tesctbook  material  and  fifty-five  errors  were  the  statis- 
tics for  tliis  topic. 

With  reference  to  Table  III,  the  first  laboratory  problan  was 
assigned  after  the  topic   'Printed  Output'   had  been  explained.     This 
problem  covered  the  usage  of  Logical  IF  statements.     The  second  prob- 
len  was  assigned  after  the  topic   'DO  Statement'.     It  dealt  with  DO-LOOP 
usage. 

The  third  laboratory  problem,  which  covered  Input /Output  was 
assigned  after  the  topic   'Format'.     Follo;d.ng  the  topic   'Built-in  and 
Arithmetic  Stat  orient  Function'  the  fourth  problem  on  functions  was 
assigned.     The  fifth  problon  on  subroutines  ^^ras  assigned  after  the 
topic  ' Subprograriimes ' .  •';•,■ 

It  was  expected  that  oocurrence  of  errors  would  be  closely  related 
to  the  laboratory  problan  assigned  and  the  material  each  covered.     For 
example,   errors  that  occurred  in  the  first  and  second  laboratory  prob- 
lems should  not  occur  as  often  in  the  remaining  problems,  because 
students  should  have  gained  experience  in  how  to  correctly  use  the 
topics  covered  by  this  material. 

Plowevei^  this  was  not  the  case  for  the  folloT-dng  five  types  of 
errors:   statsiients  and  statement  numbers,   syntax  errors,   job  terminaticn  , 
equal  signs,  and  card  foi'mat  and  contents.     Types  of  errors  for  each 
of  the  laboratory  problems  are  listed  according  to  total  frequency  of 
occurrence  in  Table  IV.     .411  of  the  five  types  of  errors  mentioned  above 
were  directly  related  to  the  topics  that  received  a  small  smiount  of 
coverage  in  the  textbook.         «•  ,,    f.  ..\ 


TABLE  IV 

LISTING  OF  ItRROR  TYPES  FOR  FIVE  PROBLaiS 

ACCORDIIX}  TO  FRaauaiCY  OF  OOCURRHiCE 
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Error  Typo 

Prob. 

Prob. 

Frob, 

Frob, 

Prob. 

.  Total 

One 

Tv:o 

Three 

Four 

Five 

"Frequency 

NONE 

61 

60 

62 

37 

20 

:240 

Statements  and  Statement  Kuinbers 

24 

20 

54 

53 

18 

169 

Syntax  Errors 

^(8 

9 

63 

29 

15 

164 

Job  Termination 

12 

13 

46 

^3 

16 

130 

infjt/outfut 

7 

5 

46 

43 

27 

:i20 

DO-LOOPS 

0 

6 

43 

44 

27 

120 

Undefined  Variables 

7 

\k 

40 

^5 

9 

115 

Parentheses 

3 

h 

71 

22 

15 

115 

Format 

13 

3 

34 

17 

44 

:ni 

Subscripted  Variables 

0 

5 

76 

7 

17 

1105 

Subscripts                                         ' 

0 

5 

35 

50 

7 

97 

Equal  Signs 

16 

11: 

41 

22 

6 

:% 

Card  FoiTiiat  and  Contents 

23 

12 

33 

12 

10 

.90 

l/O  Operations 

9 

4 

33 

29 

14 

:89 

JS  Statements 

29 

5 

22 

28 

4 

88 

Variable  Kaiues 

7 

7 

21 

10 

10 

:55 

Data  Statements              :'-.,- 

0 

2 

3 

30 

14 

-49 

Subprograi-omes                      . ._ 

2 

1 

11 

3 

17 

,34 

End  Statement                        "   ,  , 

7 

16 

0 

1 

3 

127 

Hollerith  Constants 

0 

0 

1 

21 

2 

124 

Functions  and  Subroutines 

0 

3 

8 

5 

5 

21 

FORTRAiJ  Type  Constants 

5 

3 

7 

3 

1 

119 

Powers  and  E^rponentiation 

0 

0 

14 

0 

2 

116 

Arithmetic  &  Logical  St,  Functions     0 

h 

5 

3 

1 

113 

DBiEI'lSIOK  Statements 

0 

1 

8 

2 

1 

112 

Library  Routines                      ;   '    ^ 

0 

0 

6 

0 

0 

f6 

Implicit  Statement      .     -■■•■. 

0 

0 

2 

4 

0 

-:6 

GO  TO  Statements 

2 

0 

0 

3 

1 

t6 

Equivalence  and/ or  Common 

0 

0 

1 

0 

3 

:.J^ 

Mixed  Mode                                             " 

1 

0 

1 

1 

0 

33 

Common 

0 

0 

0 

0 

2 

22 

Equivalence  Statements 

0 

0 

1 

0 

0 

11 

Job  Control  Cards 

1 

0 

0 

0 

0 

11 

TOTAL 

277 

213 

788 

5^^ 

311 

2,1'48 

14 


As  for  types  of  errors,   statements  and  statanent  munbers  was: the 
most  frequently  occurring  type  of  error.     Statements  were  either  rm- 
decodeable  or  missing.     Statament  niunbers  vjere  either  missing,  mis- 
placed,  or  multiply-defined.     Syntax  errors,  the  second  most  fre- 
quently abundant  type  of  error,  vjere  directly  related  to  the  first 
group.     SjTitax  errors  resulted  vrhen  either  an  operator,   constant, 
symbol,   or  statement  member  vjas  missing  or  illegally  used.     If  the 
amount  of  time  specified  for  the  program  was  eccceeded  or  an  errx>r 
occtirred  dtiring  compilation,   job  termination  errors  occurred. 

In  general,  variables  caused  the  most  errors.  Either  variables 
\iere  undefined,  iraproperly  named  or  incorrectly  subscripted.  A  com- 
bined total  of  376  errors  resulted  from  variables, 

GEf'ER-ALIZED  MKAI'IS  STATISTICS 

In  order  to  obtain  the  avei^age  ntmber  of  runs  for  each  lab  prob- 
l&n.  the  Statistical  Library's  Generalized  Means  Program  (I968)  was 
used.     The  average  number  of  i*uns  for  each  instructor  per  laboratory 
problem  is  shovm  in  Table  V, 

Laboratory  problems  one  and  two  required  the  least  number  of 
runs  for  all  instinactors,  approximately  two  runs.     Problems  three  and 
four  required  the  most  number  of  runs  for  instructors,  about  five. 

Only  the  runs  for  instructor  one  increased  linearly.     The  other?, 
especially  the  runs  for  instructor  f ovir ,  fluctuated.     Instructor,  one 
had  the  highest  average  number  of  runs,  followed  by  instructor  twp, 
then  foiir,  then  three,     • 


TABLE  V 
MEAIJ  m-IBER  OF  RUl^^S  FOR  EACH  LABORArORY  FROBLIM  ;-JTrHIN  EACH  INSTRUCTOR 


irl'Obletil 
Number 

Mean  for 
Instructor  1 

Mean  for 
Instructor  2 

Mean  for 
Instructor  3 

Mean  :f  or 
"Instructor  4 

1 
2 

3 
4 

VJeighted 
Average 

2.33 
2.96 
5.50 
6.12 

'■      4.61 

3.07 
2.21 

5.64 
5.^3 

4.08 

1.76 
1.53 
5.33 

5-n 

3.26 

2.40 
.1.40 
:6.22 
,3*53 

.■3.31 

Ln  Table  VI,  the  average  number  of  runs  for  each  laboratory,  prob- 
lem according  to  classification  are  shovm.     For  all  problems " but 'th-e 
second,   either  juniors  or  seniors  had  the  least  number  of  runs.   .Tor 
all  problems  but  the  second,  graduate  students  had  the  most  n-uraber-df 
runs.     Both  freshmen  and  graduate  students  rsi^uired  about  two  more.ruas 
for  problcn  three  than  the  other  classes. 

In  increasjjig  order,  classifications,  according  to  the  average 
total  niunber  of  runs  are  as  follows:   juniors,   seniors,   sophomore?, 
fresMen,  graduate  students.     However,  the  variations  between' these 
averages  were  small,  ■      . 

CHI-SQUARE  TESTS  OF  SIGKIFICMCE 

One  of  the  purposes  of  tbAs  paper  was  to  determine  if  the  follow- 
ing five  variables  liad  any  significant  effect  upon  the  errors  that  were 
made  by  beginning  prograLiming  students:   instructor,  laboratory  problan, 
msgor,   classification,  and  sex,     A  chi-square  test  was  uscsd  to  determine 
if  any  dependencies  existed. 


TABLE  VI 
1-iEAI'J  IvTO-BER  OF  RUiJS  FOR  EACH  LABORATORY  PROBLH'I 
"^■\,   ...     VOIHIW  EACH  CLASSIFICATION 
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Froblesn 

Mean  for 

Mean  for 

Mean  for 

Kean  for 

liean  f  or 

L?umber 

Freshnen 

Sophomores 

Juniors 

Seniors 

Graduates 

1       '-■'  , 

2.19 

2.56 

2.16 

2.00 

4.00 

2      ' 

1.93 

20^13 

1.85 

2.33 

"1.33 

3 

7.^3 

5.53 

4.53 

5.31 

7. '50 

k 

■    ^.75 

6.00 

5.39 

5.00 

-6.50 

Weight ed 

Average 

ii,lB 

4.15 

3.59 

3.76 

4.40 

For  the  first  clii-square  test  errors  i^ere  sorted  according  to  .fre- 
quency of  occuTrence.     The  chi-square  program  was  then  run  upon  eleven 
categories  of  errors   (the  program  used  v;as  limited  to  eleven  categories 
at  one  time).     Only  those  errors  tliat  had  a  frequency  of  occurrence -df 
five  or  greater  were  used  in  order  to  obtain  cat^ory  sizes'  large 
enough  to  give  meaningful  statistics  for  the  chi-square  program. 

The  chi-square  statistics  for  each  of  the  five  variables  tested 
against  occvirrence  of  errors  are  given  in  Table  VII.     Values  for 
degrees  of  fl'eedom  and  chi-square  critical  values  needed  for  signifi- 
cance at  the  .05'^  level  are  also  listed.     Eleven  categories,  b^inhing 
with  the  most  frequently  occurring  error,  vjere  included  in  each, group 
nviniber.     That  is,  group  1  consisted  of  the  eleven  most  frequent  errors, 
group  2  consisted  of  the  ne>:t  eleven  most  frequent  errors,   etc. 
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TABLE  Vn 
Cm-SQUABE  VALUES  FOR  FIVE  VARIABLES  TESTED  AGAIKST  SI1;GLE  ERRORS 


Categories  in  Lab,  Classifi- 

G-roups  of  11       Instructor         problem  Major  cation  Sex 


GrouD  1  '■     75.32*  268.62*  79.28*  61.86*  ll.?2 

Group  2  79.68*  ?,68.59*  62.30  71.5^*  12.8^1' 

Group  3  V  v/     '     59.55*  139.26*  49.^2  ^7.^2  9.67 

Group  ^  >        '.          65.92*  8^.08*  68.9^  51.92  13.00 

GrouD  5  57.27*  77.59*  ^5.96  31.59  :9i33 

Group  6  ^.83*  98.32*  83.12*  63. 21*  6,18 

Group  7  ^2.92      ■         70.37*  55.91  45.39  :'7*98 


Degrees  of 

Freedom  30  fMO  50  ^  -10 

Chi-Square  Value 

for  Significance    43.77    /  55«76  67.93  55'7S  "18,31 

♦indicates  significance  at   ,05/*  level 


Upon  examination  of  the  chi-square  values  it  was  found  that  "the 
variable  instructor  had  an  effect  upon  the  first  six  groups  of  error 
categories  but  no  effect  upon  the  last  group.     The  variable  laboratory 
problem  significantly  affected  all  groups  of  error  categories. 

Groups  of  error  categories  one,  four  and  six  were  affected  by  "the 
variable  rcajor  x-jhereas  the  other  groups  were  not.     The  variable 
classification  also  affected  only  tliree  groups,   one,  two,  and  six,  _The 
variable  ses:  had  no  significant  effect  upon  any  of  the  groups. 

Based  upon  the  above  results,  the  null  hypotheses  stated  on  phages 
three  and  four  for  all  variables,   except   sex,  were  rejected,     A 
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dependency  existed  between  each  of  the  four  variables,  instructor,  labora- 
tory problOT,  major,  and  classification,  and  the  variable  errors. 

At  this  point  in  the  study  the  f  ollovring  questions  became  apparent, 
I-Jas  the  variable  major  affecting  the  variable  instructor?     V/ould 
dependency  still  era.st  if  the  five  variables  i-:ere  tested  against  errors 
grouped  into  categories  according  to  type  of  error  rather  than  categories 
accoiviing  to  frequency  of  error  occiu-rence?     Therefore  the  folloi-ang 
new  hypotheses  -were  formulated: 

1)  Majors  of  beginning  programming  students  vjere  independent  of 
instructors. 

2)  Types  of  errors  made  by  beginning  programming  students  were 
independent  of  instractors. 

3)  Types  of  errors  made  by  beginning  prograjraning  students  were 
independent  of  laboratory  problem  number. 

^)  Types  of  errors  made  by  beginning  programming  students  were 
independent  of  major.  ..^^  •>-    t^„.\,^    i,-    ^^  ..■ 

5)  Types  of  errors  made  by  beginning  programming  students  were 
independent  of  classification. 

■     6)  Types  of  errors  made  by  beginning  prograiming   students  were 
independent  of  sex, 

V^en  the  variable  major  was  tested  against  the  variable  instructor, 
a  chi-square  value  of  9.9^  for  fifteen  degrees  of  freedom  resulted.     Ttes 
value  was  not  significant,     A  clii-square  value  of  25.00  v:as  needed  to 
reject  the  null  hypothesis  that  majors  of  beginning  programming  students 
are  independent  of  instructors. 
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In  order  to  detemine  if  the  last  five  mai  hypotheses  of  inde- 
pendence stated  above  could  be  rejected  or  accepted,   errors  were 
grouped  into  categories  according  to  types  of  errors.     These  error  types 
are  listed  in  Appendix  B,     The  clii-square  program  was  then  used  to 
test  the  variables  instructor,  laboratory  problem,  major,  classification, 
and  sex  against  tjpes  of  errors.     The  results  of  this  test  are  shown'  in 

Table  VIII. 

Because  of  the  nature  of  the  chi-square  test  only  the  types  of 
errors  that  consisted  of  txjo  or  more  errors  that  had  a  frequency  i)f 
occurrence  of  five  or  greater  were  used  in  the  above  test,     Th-is  was 
necessary  to  obtain  meaningful  values  from  the  chi-square  test,     A  total 
of  twenty  tj^jes  of  errors  were  tested. 

The  variable  instructor  significantly  influenced  three  types  i>f 
errors,  format  (first  grouping),   functions  and  subroutines,  and  sub- 
scripted variables,     Chi-square  values  for  the  variable  laboratory 
problan  were  significant  for  thirteen  types  of  errors.     This  variable 
influenced  more  types  of  errors  than  did  any  of  the  other  variables. 
Sirdlar  results  were  also  shorn  for  the  variable  laboratory  problem 
by  the  chi-square  test  for  single  errors. 

Five  types  of  errors  had  significant  chi-square  values  for  the 
^i-ariable  major.     Those  five  types  were  data  statement,  format  (first 
grouping),   job  termination,  undefined  variables,  and  subscripts. 

The  vai'iable  classification  was  significant  for  the  folloiving 
fotir  types  of  errors:   format  (first  grouping),   job  termination,  unde- 
fined variables,  and  if  statements.     Only  three  types  of  errors  showed 
significance  when  tested  against  the  variable  sex.     These  types  v;ere 
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Input/Output  (second  groupins),   job  termination,  and  equal  signs. 

Table  IV  listed  the  error  types  in  order  of  frequency  of  occurrence. 
Of  the  sixteen  most  frequently  occurring  error  types,  three  of  these, 
format   (second  grouping),   Inpait/Output  (first  grouping),   and  paren- 
theses were  independent  of  any  of  the  five  variables. 

Six  of  the  error  types  were  affected  by  one  variable,  five  by  two 
variables,  and  three  by  tb-ree  variables,     to  expressed  another  way, 
50^  of  the  sixteen  most  frequently  occurring  error  typos  wei-e  signi- 
ficantly iafluenced  by  either  aero  or  one  variable  and  50ji  by  either 
two  or  three  variables. 

Statements  ajid  statement  numbers,   syntax,  Input /Out  put,  DO-LOOPS, 
parentheses,  card  format  and  contents,  l/O  operations,  format,  and 
variables  names  i^ere  the  error  types  affected  by  one  or  zero  variables. 
Job  termination,  undefined  variables,  format,   subscripted  variable?, 
subscripts,   equal  signs,   IF  statements,  and  DATA  statements  were: the 
error  types  affected  by  two  or  three  variables. 

Based  upon  the  above  results,  the  hypothesis  that  the  typesrof 
errors  made  by  beginning  programming   students  are  independent-  i>f 
laboratory  problan  number  was  rejected.     The  other  four  hypotheses 
concerning  types  of  errors  were  accepted. 

SWa>IARY 
In  summary,  male  students  made  slightly  more  errors  than  female 
students.     Sophomores  made  the  fewest  percentage  of  errors,  compsred:.to- 
total  representation,  while  juniors  made  the  most  errors.     Hatheraaties 
majors  made  slightly  fewer  errors  and  agriculture  majors  made  slightly 
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more  errors  when  the  percentage  of  errors  made  by  students  was  ccxn- 
pared  to  the  percentage  of   students  mthin  a  major. 

Thirteen  of  a  possible  2S1  errors  accounted  for  5C^  of  the  total 
2,148  errors  made.     NONE  was  the  most  frequently  occurring  error. 

Thirty-two  different  types  of  errors  occurred.     Statements  and 
statenent  numbers  was  the  most  frequently  occurring  type  of  error. 

Instructors  somewhat  influenced  the  average  number  of  runs  per 
lab  problem.     Graduate  students  and  freshmen  required  the  most  number 
of  runs,  while  juniors  the  least  number  of  runs. 

Chi~square  values  indicated  that  when  the  five  variables  instractor, 
laboratory  problesa,  major,  classification,   and  sex  were  tested  against 
single  errors,  dependence  ecisted  for  the  first  four  variables  and 
independence  existed  for  the  variable  sex.     The  variable  major  was 
independent  of  the  variable  instructor.     VJhen  the  chi-square  test  was 
applied  to  types  of  errors,   only  the  variable  laboratory  problera  showed 
dependence.     The  other  four  variables  were  independent  of  types  of 
errors  and  their  corresponding  hypotheses  were  accepted. 

:  :>  '    '■  ■  -  CONCLUSIONS 

The  results  of  this  study  showed  tliat   some  errors  occurred  more 
frequently  than  other  errors.     Therefore  it  was  possible  to  deterinine 
vrtiat  kinds  of  errors  v;ere  made  by  beginning  programming   students. 

Based  upon  the  chi-square  values  for  the  five  variables  testsd 
against  the  occurrence  of  single  errors,  independence  e>:isted  for  the 
variable  sere  while  dependence  existed  for  the  variables  instructor, 
laboratory  problem,  major,   ajid  classification.  '  . . 
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VJhen  errors  were  grouped  into  types  of  errors  only  the  variable 
laboratory  problem  vjas  depandent  upon  the  variable  errors.     Therefore, 
all  the  hj'potheses  of  the  variables  that  showed  dependence  were  rejec- 
ted and  the  hypotheses  of  the  variables  that  showed  independence  were 
accepted.  ••   , 

RSCaffi-EimATlONS 

As  a  res^alt  of  this  study,   a  list  ox  the  most  frequent  errors 
and  error  t^-pes  was  obtained.     In  order  to  determine  if  the  Icnowledge 
of  these  errors  could  hjive  any  effect  upon  reducing  their  occurrence, 
more  similar  studies  \-n.ll  have  to  be  conducted.     Perhaps  by  having- the 
instractors  nore  thoroughly  e:cplain  the  usage  of  the  most  frequently 
occurring  errors,  their  occurence  could  be  reduced. 

Also  there  nay  be  other  factors  that  might  significantly  affect 
error  and  error  type  occurrence.     For  example,  the  amount  of  emphasis 
that  the  instructor  put  upon  the  students  to  accurately  complete  the 
questionnaire  would  affect  the  result's.     Another  factor  might  be  the 
anoTxnt  of  prior  knowledge  tliat  a  student  night  have  upon  entering 
such  a  course.     There  roay  be  other  meaningful  ways  to  group  the  (srrors, 
t)Jl  of  those  neod  to  be  checlced  for  significaiit  effect  upon  errors. 
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i\I^PEl-;DIK  B 

mUCR  Di^SCRIPTIOKS  Alffl  FI133USKCIES 
In  this  Appaidix,  the  diagnostic  message  codes  printed, out. by 
the  VJATFOil/360  conpiler  are  given,     Nejct  to  each  nessage:  code  vis  its 
frequency  of  occurrence  and  its  diagnostic  message.     Errors  are 
grouped  into  types  and  the  total  frequency  of  occurrence  for  .each 
error  type  is  given, 

CARD  FOKLftT  iU®  CX}KTaMTS 

CC-0       32         ColTorms  1-5  of  Continuation  Card  Hot  Blank. 

Too  :iany  Continuation  Cards   (Ilaximum  Df:5)» 

Invalid  Character  in  Fortran  Statement. 

First  Card  of  a  Rrograriuie  is  a  Continuation  Card,    /Probable 
Causa  Statement  Punched  to  Left  of  Column'^?. 

Blanl-c  Card  Encountered, 

Keypu2ich  Used  Differs  fron  Keypunch  Specified  on 'the  "Job  Card. 

First  Character  of  Statement  L'ot  Alphabetic. 

Invalid  Claaracter(s)   Concatenated  x-rith  Fortran 'Keytjord. 

Invalid  Characters  in  Columns  2-5.     Statement  Number  llgnored 
Probable  Cause-Statoiient  Punched  to  Left  of  :'CbluBm~7. 

90  •■.:      ■ 

camoii  .-.       ■  -    ..  .  ■  ."■•:' 

ai-3         2         Initializing  of  Coirjion  Should  Be  Done  in  a  Block  Data  Sub- 
programme. 

~2  ..;-.,      ~~^. '.;■■.■,./„ 

FORTRAi^I  TYPE  COliS'TAIvTS  ■    ' 

CK-6       19         Illegal  Use  of  Decimal  Point. 

^        -    ■       "■      ,     '         -  ■-     ..    " 


CC-1 

1 

CC-2 

9 

cc-3 

7 

cc-5 

4 

CC-6 

4 

CC-7 

22 

CC-8 

2 

cc-9 

9 

DA-2 

9 

DA-5 

1 

DA-6 

7 

28 

DATA  STATa-iSIIT 

DA-1         7         Kon- Constant  in  Data  Statement. 

More  Variables  than  Constants  in  Data  Statement, 

Expended  Data  Statement  not  in  /360  Fortran, 

Non-Asreenent  between  Type  of  Variable  a:nd  Constant- in' Data 
Statement, 

DA-8         h        Variable  Previously  Initialized.     Latest  Value  Us^,     Check 
Common/Equivalenced  Variables, 

DA-9         2         Initializing  Blanlc  Corraon  not  Allowed  in  /36O  Fortran, 

DA-A      11         Invalid  Delimiter  in  Constant  List  Portion  of  Data,  Statesierfc  , 

DA-B         8         Truncation  of  Literal  Constant  has  Occurred. 

59 

DUIEITSIOIJ  STATEIffilNlTS 

U/l-O         5         No  Dimensions  Specified  for  a  Variable  in  a  Dimension:  State- 
ment, 

Initialization  in  Dimension  Statement  is  IllegaJ., 

Attempt  to  Re-dimension  a  Variable, 

Attanpt  to  Dimension  an  Initialized  Variable, 


Dy-2 

1 

mi~3 

4 

DII-4 

2 

12 

DO  LOOPS 

DO-0 

4 

DO-1 

16 

DO-2 

9 

DO-3 

11 

DO-4 

7 

DO-5 

51 

DO-7 

IB 

Illegal  Statement  Used  as  Object  of  DO, 

Illegal  Transfer  into  the  Range  of  a  DO  LOOP, 

Object  of  a  DO  Statement  has  Already  Appeared. 

Improperly  nested  DO-LOOPS. 

Attempt  to  Redefine  a  DC-LOOP  Parameter  V/ithin  Range  of. Loop, 

Invalid  DO-LOOP  Parsjneter. 

DO-Parameter  is  Undefined  or  Outside  Range, 
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DO-8        3        This  DO  LOOP  Will  Teminato  after  First  Tine  Through. 
DO-9         1         Attempt  to  Redefine  a  DO-Loop  Parameter  in  an  Input  List. 
llO         . 

BQUIVALSIICE  AI!D/0R  CCmiOl^i 

EC-1         3         Cormon  Block  has  a  Different  Length  tlian  in  a  Previous 
Subprogramne. 

EC-8         1         Variable  Used  vdth  Non-Constant  Subscript  in  Common/Equi- 
valence List, 

"T?  ■,.       -    .-,-'-, 
END  STATMiSKTS 

EK-0       24         Mo  End  Statanent  in  Prograwme  -  End  Statement  Generated. 
EI^!-1         3         End  Statement  Used  as  Stop  Statement  at  Execution. 

2? 
EQUAL  SIGNS  :,;■■         / 

SQ-6       29         Illegal  Quantity  on  Left  of  Equal  Sign, 
m-8       ^         Illegal  Use  of  Equal  Sign. 
EQ-A       23         Multiple  Assignment  Statements  not  in  /36O  Fortran, 

9?  -    ^  „..  :  ■■.    ■ 

3QUIVi^LEi\^CS  STATMErfTS 
EV-2         1         Less  than  2  Members  in  an  Equivalence  List, 

P0VI5RS  AI^ID  SXPONSt-TTIATION 

EX-9       16         X**Y  V/here  X.LT.O.O,   Y.NE.O.O. 

FOHl-IAT  _  '■;  ^  ■•.■■■.. 

HI-0       33         Invalid  Character  in  InjTut  Data. 

FH-2         2         1:0  Statement  Nun:ber  on  a  Format  Statement, 
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Format  Specification  and  Data  Type  Do  Not  Fatch. 
Incorrect  Sequence  of  Characters  to  Ini^ut  "Data. 
Invalid  Character  Encountered  in  Format. 
Invalid  Form  Follox-dng  a  Specification. 
Invalid  Field  or  Group  Count. 
A  Field  or  Group  Count  Greater  than  25 5 • 
No  Closing  Quote  in  a  Hollerith  Field. 
Invalid  Use  of  Comma. 

Character  Follows  Closing  Pd-ght  Bracket. 
Invalid  Ch^.racter  Before  a  Right  Bracket. 
I-Iissing  or  Zero  Length  Hollerith  Encountered. 
No  Closing  Pdght  Bi'acket, 

.     ■  .-  ( 

FUNCTIONS  AI':D  SUBROUTINES 

FN-3         1         Repeated  jVrgument  in  Subprogramme  or  Statement  Function 
Definition. 

FN-'^       11         Subscripts  on  Right  Hand  Side  of  Aritlmetic  Statecient 
Function. 

FN-7         8         Invalid  Argtiment  in  Arithraetic  or  Logical  Stataiient  Functioo. 
FN-8         1         Argument  of  Subprogramme  is  Same  as  Subprogramme  Name. 

I  ... 

21 

GO  TO  STATMBtJTS 

GO-0         3         Statement  Transfers  to  Itself  or  to  a  Non-Executable-  State- 
ment. ?    .- 

GO-2         1         Index  of  Computed   'Go, To'  is  Negative  or  Undefined, 

GO-3         2         Ei-ror  in  Variable  of   'Go  To'   Statement. 


Fi'I-5 

22 

FL-I-6 

1 

FT-l 

16 

FT -2 

n 

Fr-3 

2 

FT -4 

4 

FT-6 

4 

FT-? 

3 

FT-A 

k 

FT-D 

1 

FT-S 

4 

FT-F 

8 

111 

.31 

HOLLERITH  CONSTANTS   ■  '"" 

HO-1    1    Zero  Length  Quote-Type  Hollerith. 

HO-2    1    No  Closing  Quote  or  Next  Card  not  Continuation  Card. 
HO-3   10    Hollerith  Constant  Should  Appear  only  in  Call  Statement, 
Ho-4   12    Unexpected  Hollerith  or  Statement  lumber   Constant, 
..  •   k      ^ 

IF  STATn-IS'ITS  (APITmsriC  A-KD  LOGICAL) 
IF-0    7    Statement  Invalid  after  a  Logical  IF. 
IF-3   5-^    Arithmetic  or  Invalid  Expression  in  Logical  IF. 
IF-4   27    Logical,  Complex,  or  Invalid  Expression  in  j^rithmeticTIF. 
■   :    88       .         \    •,  \ 

BiPLICTT  STATS-IENT     '    '  ^  '',,■ 

H'l-O    4    Invalid  llode  Specified  in  an  Implicit  Statement. 
IM-1    1    Invalid  Length  Specified  in  an  Implicit  or  Type  Statament. 

BI-4    1    Specification  Kust  Be  Single  Alphabetic  Character,  First 
Character  Used. 

"6    ■,   .  ■'-■-<.  -    .  ■  ■";':.:/,  ■ '. 

ikput/outfut  •■       '  ■' 

lO-O         5         Massing  Comma  in  l/O  List  of  l/o  or  Data  Statement. 

10-2       13         Statement  Number  in  l/O  Statement  not  a  Format  Statement 
Number. 

10-3       1^         Buffer  Overfloxj  -  Line  Too  Long  for  Device. 

10-6         8         Variable  Format  not  an  Array  Name. 

Invalid  Element  in  Input  List  or  Data  List. 

Type  of  Variable  Unit  not  Integer  in  l/O  Statement, 

Invalid  Eleanent  in  an  Outi^it  List. 

I-assing  or  Invalid  Unit  in  l/O  Statement. 


10-8 

16 

10-9 

6 

lO-C 

26 

lO-D 

1 

■   :•:■  r    :  ■:     :  '  .32 

'.■■'■/■■  •■  1- 

lO-F   12    Invalid  Delimiter  in  Specification  Fart  of  l/O  Statement. 
lO-J   17    Invalid  Delimiter  in  l/O  List, 

lO-K    2    Invalid  Delimiter  in  Stop,  Fause,  Data,  or  Tape  Control 
Statenent, 

■  120 

JOB  CONTROL  CARDS  '  .     •,  , 

JB-1         1         Job  Card  Encountered  Diiring  Compilation.  ■  '    -. 

■  ' ; .        "T     ■     ■         ..  ,      • 

JOB  TKRI4B:ATI0N 

KO-0     103         Job  Terminated  in  Execution  because  of  Compile  Time  Error. 

KO-1         1         Fixed  Point  Division  by  Zero. 

KO-2         3         Floating  Point  Division  by  Zero.  ■■'..• 

KO-3         3         Too  Many  Exponent  Overflows.  ■       •^ 

KO-6       18         Job  Time  Eicceeded. 

KO-8         2         Integer  in  Input  Data  is  Too  Large. 

130  ^    ■  ■   ■ 

LIBRARY  ROUTINES        '  .-■  ' 

LI-C         6         Negative  Argument  for  Sqrt  or  Dsqrt. 

l-EEXED  MODE  ,   •     >    '". 

MD-3         1         Relational  Operator  has  a  Complex  Operand. 

LiD-4         2         I'Jixed  l-lode  -  Logical  vn.th  Arithmetic. 

"  ■  ^       .  "3     ■ 

PARSi^THESES  '  '     ,;'  ''_'■     -'       .  ^-V  ■  • 

PC-O   96    Unmatched  Parenthesis 
PC~1   19    Invalid  Bracket  Nesting  in  l/O  List.. 
115   . 


SF-1 

5 

SF-2 

5 

SF-3 

3 

33 


ARTTH'EriC  AI'ID  LOGICAL  STATaiEf'IT  FUNCriONS 

Pre-vT-Ously  Referenced  Statement  Nunber  on  Statement  Panctiono 

Statement  Function  is  the  Object  of  a  Logical  IF  Statement, 

Recursive  Statement  Fimction,   Mame  Appears  on  Both  Sides 
of  =.         .  . 

13         ; 

SUBPRCGRAl-IMES 

SR-0       17         Missing  Subprogramme. 

SR-2         3         Subprogramme  Assigned  Different  Modes  in  Different  Pre- 
gramme  Segments. 

Invalid  Type  of  Argument  in  Subprogramme  Referenceo 

V/rong  Kuraber  of  Ai'guments  in  Subprogramne  Reference. 

Subprogramme  Name  Previously  Decined  -  First  Reference 
Used.  / 

No  I-Iain  Prograriime.  ;; 


SR-'f 

6 

SR-7 

1 

SR-8 

6 

SR-9 

1 

3^ 

SUBSCRIPTS 

SS-0 

k 

SS-1 

91 

SS-2 

2 

Zero  Subscript  of  Dimension  not  Allowed. 

Subscript  out  of  Range. 

Invalid  Variable  or  Name  Used  for  Dimension. 

97 

STATH-ia^'S  AiiD  STATH-IHvT  KU^IBERS 

ST-0       39        Hissing  Statement  Number. 

ST -3       23         Multiply-Defined  Statement  Itonber. 

ST -4       19         No  Statement  Number  on  Statement  Following  Transfer 
Statement. 

ST -5       65         Undecodeable  Statement. 


3^ 


ST -7         2         Statement  Kumber  Specifiod  in  a  Transfer  is  the  Mjmber  of 
a  Kon-Sxecutable  Statement. 

ST-9         6         Statement  Specified  in  a  Transfer  Statement  is  a  Fonaat 
Statanent. 

ST-A       15         Kissing  Forraat  Statonent, 

SUBSCRIPTED  VARIABLES 

SV-0       33         V/rong  Kuraber  of  Subscripts* 

SV-1       45         Array  Hame  or  Subprogramme  Name  Used  Incorrectly  •t-dthout.Iist* 

SV_4       15         Variable  -with  Variable  Dimensions  is  not  a  Subprogramme 
Fararaeter, 

S'/-5       12         Variable  Dimension  Neither  Sir/iple  Integer  I'ame  Nor:  Sab- 
programme  Parameter, 

'105  '    '      ' 

Syi'ITAX  ERRORS  (liRRORS  DETECTED  IN  ATTa-IFPIKG  TO  DECODE  OI.'E  STATMEL^T) 

SX-0     102         iiissing  Operator, 

Synt?jc  Error  -  Searching  for  S^nnbol,  None  Found, 

Syntax  Error  -  Searching  for  Symbol  or  Constant,  None~Fouiido 

SjTitax  Error  -  Searching  for  Statement  IJuraber,   None  Fouiid, 

Syntax  Error  -  Searching  for  Sim.ple  Lnteger  Variable,  None 
Found, 

Illegal  Sequence  of  Operators  in  Expression, 

Missing  Operand  or  Operator. 

lS5        .   •   ■  ■     ^ 

l/O  OPERATIONS  ;    ,   " , 

UN-0       68         Control  Card  Encountered  on  Card  Reader  During  ExecutioQ, 

UK-1         2         find  of  File  Encountered. 

UK-7       14        Too  Ilany  Pages  of  Output,  •  f 


SX-1 

7 

sx-3 

3 

sx-k 

22 

sx-5 

3 

SX-C 

19 

SS-D 

8 

35 


UN-9    5    You  Have  Attempted  to  Write  Onto  the  Card  Reader,  or  to 
Read  from  the  Line  Printer  or  Card  Punch, 

89 

UNDEFIKED  VARIABLES,  I.E.,  VARIABLES  VJHICH  HAVE  BEEN  ASSIGNED  NO  VALUES 

SO  FAR 

UV-0   52    Undefined  Variable  -  Simple  Variable. 

UV-1  .  1    Undefined  Variable  -  Bquivalenced,  Corjnoned  or  Dummy 
Parameter. 

UV-2   61    Undefined  Variable  -  Array  Member, 

UV-6    1    Variable  Format  Contains  Undefined  Character(s), 

ii5   ^       ■:;:;■":..,■ 

VARIABLE  KAI^ISS  ,    _^   .       .' 

VA-0         2         Attonpt  to  Redefine  Type  of  a  Variable  Name. 

VA-2       29         Variable  Na-ine  Longer  than  Six  Characterso     Truncated  to  Six. 

VA-4         2         Attempt  to  Redefine  the  Type  of  a  Variable  Name. 

VA-6         1         Illegal  Use  of  a  Subroutine  Name. 

VA-8       20         Attempt  to  Use  a  I^ervlously  Defined  Kariie  as  Function  or 
Array. 

VA~C         1         Name  Used  as  a  Subprogramme  Name  was  Previously  Used  as- a 
Common  Block  Label, 
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It  was  the  purpose  of  this  study  (1)  to  determine  what  errors  were 
made  by  beginning  programraing  students  and  (2)  to  determine  what  effect 
the  follovjing  variables  had  upon  the  errors  that  vrere  made  by  students: 
instructor,  laboratory  problem,  major,   classification,  and  sex. 

The  objectives  of  this   study  stated  as  null  hypotheses  were: 

(1)  Errors  made  hy  beginning  programming  students  were  inde- 
pendent of  instructor. 

(2)  Errors  made  by  beginning  programining  students  were  inde- 
.    .,                  pendent  of  laboratory  problon, 

(3)  Ei'rors  made  by  beginning  programjiiing  students  were  inde- 
pendent of  major. 

(4)  Errors  made  by  beginning  programming  students  were  inde- 
pendent of  classification. 

-    V 

(5)  Errors  made  by  beginning  prograriiming  students  were  inde- 
pendent of  sex, 

(6)  liajors  of  beginning  programming  students  were  independent 
of  instructor. 

(7)  Types  of  errors  made  by  beginning  programming  students 
were  independent,  of  instructor. 

(8)  Types  of  errors  made  by  beginjiing  programming  students 
vjere  independent  of  laboratory  problan. 

(9)  Types  of  errors  made  by  beginning  programming  students 
were  independent  of  piajor. 

■ ' '    /  '" 

(10)  Types  of  errors  made  by  beginning  programming  students 
were  independent  of  classification. 

(11)  TjTpes  of  errors  made  by  beginning  programming  students 
were  independent  of  sex. 

Data  for  the  study  were  collected  by  use  of  a  questionnaia^e.     Data 

gathered  from  the  questionnaire  consisted  of  laboratory  problem  numboy, 

instructor,   error  code,  type  of  error  and  run  number.     Eight y-fotir 


students  enrolled  in  a  b^inning  programming  course  from  Kansas  State 
University,  I'lanhattan,  Kansas,  participated  in  the  study. 

The  results  of  the  study  showed  v/hat  errors  were  riade  by  beginning 
programming  students.     Based  upon  chi  square  values  for  the  five 
variables  tested  against  the  occurrence  of  errors,  indepandence  exis- 
ted for  the  variable  sgcc  while  dependence  existed  for  the  variables 
instructor,  laboratory  problon,  major,  and  classification. 

The  variable  major  was  independent  of  the  variable  instructor, 

Chi  square  values  for  the  five  variables  tested  against  types  of  errors 

showed  dependence  for  the  variable  laboratory  problan.     Independence 

was  indicated  for  the  variables  instructor,  major,   classification,  and 

se3C  when  tested  against  types  of  errors, 

/  ;  ....     . 


